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A SYSTEM AND METHOD FOR 
COMMUMCATING D^ORMATION RELATING TO A NETW 

CROSS REFERENCE TO RELATED PROVISIONAL APPUCATIONS 
This application claims the benefit of provisional application serial nos. 60/028,251 (entitled 
''A Method and System for Communicating Information About the Contents of a Document''), filed 
October 8, 1996; 60/047,554 (* A Document Retrieval System Including Use of Profile Information"), 
filed May 22, 1997; and 60/052,830 (''A System and Method for Communicating Information Relating 
to a.Network Resource"), filed July 17, 1997. 



BACKGROUND AND SUMMARY OF DISCLOSURE 
12 A continuing difficulty in today's information-rich society is effectively communicating 

pertinent information to those individuals who are most interested in it. A related problem in the art is 
p4 efficiently and effectively finding pertinent information. Traditionally, methods for finding pertinent 
D information or for guiding the user to information of interest are cumbersome and often ineffective. 
lJ6 Some of the systems and methods disclosed herein can be used for finding, presenting and^r 
^1 communicating useful and relevant information, including methods relating to guiding individuals to 
p8 places of interest, and methods relating to the presentation of information that is pertinent to a 

particular mdividual's interests or situation. Additional embodunents and features, and the nature of 
mo the present invention may be more clearly understood by reference to the following detailed 

p description, the appended claims, and the several drawings herein. 

ly ■ 

hi 

^ BRIEF DESCRIPTION OF THE DRAWINGS 

24 Figure 1 is a block diagram of a computer system attached to a network. 

Figure 2 is a diagram of multiple computers on a network. 
26 Figure 3 is a sunplified representation of a screen showing a window in which information 

retrieved over a network is displayed. 
28 Figure 4 is the view of Figure 3 with an additional window shown on the display, in which 

supplemental information is displayed. 
30 Figure S is a network diagram showing the retrieval of supplemental information by a client 

computer. 
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Figure 6 is a flow chart illustrating the process for retrieving and presenting supplemental 
2 information in the network of Figure 5. 

Figure 7 is a network diagram showing an alternate procedure for retrieval of supplemental 
4 information. 

Figure 8 is a flow chart illustrating the process for retrieving and presenting supplemental 
6 information in the network of Figure 7. 

Figure 9 is a network diagram showing an alternate procedure for retrieval of supplemental 
8 information* 

Figure 10 is a flow chart illustrating the process for retrieving and presenting supplemental 
10 information in the network of Figure 9. 

Figure 11 is a netwoifk diagram showing network activity and inter-process communication at 
12 the client computer. 

Figure 12 is a flow chart illustrating the process diagrammed in Figure 11. 

■J . - ^ 

04 Figure 13 is a network diagram showing an alternate implementation of two processes 

p executing at the client program. 

5_16 Figure 14 is a flow chart illustratmg the process diagrammed in Figure 13. 

Figure 15 is a flow chart ilhistrating a server process similar to that shown m Figures 11 and 

US 13. 

|: Figure 16 is a simplified rqpresentation of a database or look-up table that may be used by a 

server computer. 

Figure 17 is a flow chart illustrating a process in which a client computer sends a request to a 
reference server in certain circumstances. 

Figure 18 is a flow chart illustrating a process in which a client computer determines whether 
24 supplemental information is available for more than one document. 

Figure 19 is a view of a screen showmg a window in which supplemental information is 
26 displayed. 

Figure 20 is a view of a desktop having a display element that the user can select to display 
28 supplemental information. 

Figure 21 is the desktop of Figure 20 after selection of the display element. 
30 Figure 22 illustrates a display screen on which supplemental information is scrolled in a 

window. 
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Figure 23 illustrates a display screen informing the user that supplemental infonnation or 
2 supplemental content reladng to other content on the display screen exists. 

Figure 24 illustrates the display screen of Figure 23 when supplemental information is 
4 presented to the user. 

Figure 25 illustrates the display screen of Figure 24 after the user selects the supplemental 
6 information presented to the user in Figure 24, 

Figure 26a illustrates rotation of supplemental infonnation m a window in Figure 24. 
s Figure 26b is a flow chart of a process in which the displayed supplemental information 

remains substantially constant during the time that the input device is active. 
10 Figure 27 illustrates a browser or document viewing program having an area in which 

supplemental information may be displayed. 
12 Figure 28 is a flow chart illustrating a process for presenting a supplemental resource or 

supplemental content to a user. 
|44 Figure 29 illustrates the selection of a display element while content m a browser is presented 

^ to a user. 

ys Figure 30 illustrates the updated display screen after the selection of the display element in 

Figure 29. 

fts Figure 31 illustrates the display screen of Figure 30 showing display elements representing 

^ various types of supplemental information on a task bar. 

Figure 32 illustrates the updated display screen upon selection of a task bar display element in 



H Figure 32. 

m Figure 33 is a network diagram ilhistrating network activity in connection with Figures 29, 30» 

'^ \y 31. and 32. 

24 Figure 34 illustrates a number of display elements that may be used to represent different types 

of supplemental information. 
26 Figure 35 is a flow chart of a process similar to that illustrated m Figures 29 to 33. 

Figure 36 is a flow chart illustrating an alternate process. 
28 Figure 37 is a flow chart of the process illustrated in Figures 38a and 38b. 

Figure 38a illustrates infonnation being displayed in a window. 
30 Figure 38b illustrates supplemental infonnation being displayed in the window of Figure 38a. 

Figure 39 illustrates an alternate method of displaying supplemental information. 



3. 



11:29 ni,a 



o o 

Figure 40 is a network diagram in which supplemental information from more than one source 
2 is retrieved. 

Figure 41 illustrates a menu being displayed upon selection of a display element. 
4 Figure 42 illustrates presentation of supplemental information upon selection of a menu item in 

Figure 41. 

6 Figure 43 illustrates an alternative menu being displayed upon selection of a display element. 

Figures 44 to 46 illustrate another procedure for selection of the desired type of supplemental 
8 information. 

Figure 47 illustrates an alternate way of presenting supplemental information in connection 
10 with the procedure illustrated in Figures 44 to 46. 

Figures 48 and 49 illustrate the selection and display of supplemental information relating to 
12 audio content. 

Figure SO illustrates the presentation of the audio content relating to the supplemental 
M4 information of Figure 49. 

2 The foregoing drawings ilkistrate various features and aspects of the preset 

l^ie merely ilhistrative, and are not intended to limit the present invention in a manner not required by the 
appended claims. 




5 DETAILED DESCRIPTION 

1^0 Figure 1 is a block diagram of a general purpose computer 102 that may be used to implement 

H one or more embodiments of the present invention. The computer 102 has a central processmg unit 
g2 (CPU) 104, memory 113, and input/ou^ut (i/o) ckcuitry 112. The CPU 104 is connected to the 
W memory 113 and flie i/o circuitry 112. The i/o cocuitry permits the CPU 104 to access various 
24 peripheral devices, such as the display 108, local storage 106, and mput device(s) 110. The input 
device(s) 110 may mclude a keyboard, mouse, pen, voice-recognition ckcuitry and/or sofhvare, or any 
26 other input device. Some type of secondary or mass storage 106 is generally used, and could be, for 
example, a hard disk or optical drive. The storage 106 can also be eliminated by providing a sufficient 
28 amount of memory 113. Either the storage 106 or the memory 113 could act as a program storage 
medium that holds instructions or source code. The i/o cu:cuitry 112 is also connected to a network 
30 1 14, thereby connecting the computer 102 to other computers or devices. 

Figure 2 is a representation of multiple computers (251, 252, 253, 254, 255, 256, and 257) 
32 connected together to form a network of computers and/or networks. Computers 251, 252, and 256 
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are shown connected to wide area network (WAN) 263, whereas computers 253, 254, 255» and 257 
2 are shown interconnected by local area network (LAN) 261. The LAN 261 is connected to the WAN 
263 by connection 262. 

4 Figure 3 shows a simplified representation of a video display screen 304 for a compute such 

as that of Figure 1. The area 304 represents the area on a screen within which images, text^ video, 
6 and other type of data or multimedia objects can be displayed and manipulated. On the display 304 

shown in Figure 3, a cursor 301, and a number of display elements, icons, or objects 302 are shown. 
8 Another type of object, window 306, is also displayed on the display 304. The window 306 is 

a representation of a document retrieval, browsing, and/or viewing program that is used to view or 
10 interact with information or resources either stored locally on the computer or retrieved over a 
network. The window 306 has a title area 308 that displays the title of the resource or document being 
12 displayed, along with the server on which the document is located. The title area 308 could also 
display the location or address of the document being displayed, or also the universal resource locator 
rt4 of the document being displayed. Alternatively, an additional area within the window could be used 
9 for displaying the universal resource locator in the manner implemented by commercially avsdlable 

in ■ . 

1^6 browsers^ 

Shown within the document viewing area of the wmdow 306 in Figure 3 are the contents of a 
Ms document or page published by Universal Theatres^ Inc.« and made avsdlable at its server over a wide 
area or global network (e.g.» the Intemet*s World Wide Web). This particular document or web page 
Ho relates a motion picture produced by Universal Theatres entitled ^'Flymg Over The Precipice." As 
11 1 indicated in the window 306, actors named Warren Barrett and Annette Foster star m the movie. The 
^2 document or page shown in wmdow 306 is made available by Universal Theatres (on a wide area or 
global network) for browsing by, for example, people that may be mterested m seemg this particular 
24 movie. The page in Figure 3 (or others accessible from it) may provide information about which local 
theaters are showing the movie, and the times it is being shown. The page may also offer previews of 
26 the movie in the form of audio or video clips that encourage the viewer to see the movie. 

Still referring to Figure 3, some promotional information is also provided in an area 310 on the 
28 right side of the page. This promotional information is in the form of a list of favorable reviews that 
have been given to the "Flying Over the Precipice" movie. For example, Joel Seagull of ABC News 
30 gave the movie "five stars," and other reviewers also gave the movie a favorable review. These 
reviews might be selected by Uxuversal Theatres, Inc. for inclusion in this page to encourage the 
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viewers of the page to see the movie. For this reason, favorable reviews may sometimes be the only 
2 reviews included such a page. 

A banner advertisement 312 is also displayed at the top of the page, which promotes another 
4 Universal Theatres movie, "Time Will Tell.** Selection of such a baimer ad may retrieve and display 
in the window 306 information about the advertised movie. The banner ad 312 could alternatively 
6 promote other entertamment choices, or other goods or services if Universal Theatres chooses to sell 
advertisement space on its pages to thurd parties. For example, a supplier of soft drinks to patrons of 
s movie houses showing Universal Theatres pictures may choose to invest in advertising on one or more 

of Universal Theatre* pages» 
10 In Figure 4, a simplified representation of a video display or screen is shown where window 

306 is present, as was the case in Figure 3, but in addition, a window 320 is also shown on the 
12 display. In the embodunent shown, the window 320 is displayed automatically when the user retrieves 
and displays the Universal Theatres page shown in window 306. The window 320 contains excerpts 
from various reviews of the movie ^Flying Over the Precipice. 

In the particular embodiment shown in Figure 4, the information in the window 320 is not 
,16 created or published by Universal Theatres, This information is instead created and published by a 
I: third party in this embodiment, such as a movie review organization that seelcs to pro'^de a well- 
Hs balanced, and even-handed representation of the reviews a particular movie is receiving* The page 
published by Universal Theatres and shown in window 306 in Figure 4 may not link to or point to 
'^0 where the information in window 320 can be found on the network. 

'fl Shown in window 320 are four reviews of the movie **FIying Over the Precipice," mcluding 

p2 the favorable review by Joel Seagull of the (fictional) ABC News. The other tiaree reviews shown in 
window 320 (from Wire Services Ratings, MetroPages Reviews, and TimeLme Reviews) are not as 
24 favorable and may discourage the viewer from seeing the movie **Flying bver the Precipice. In fact, 
the information provided in window 320 reveals quite a different tone from the reviewers than the set 
26 of reviews cited by Universal Theatres on its **Flying Over the Precipice" web page m window 306, 
Universal Theatres has omitted from its **Flying Over the Precipice* web page (shown in window 306) 
28 some of the reviews quoted in window 320, 

As can be seen from the embodiment of Figure 4y the information provided by Universal 
30 Theatres on the page shown in window 306 may not be an accurate or even-handed representation of 
the reviews the subject movie is receiving. Nor would one necessarily expect that Universal Theatres 
32 would provide an entirely accurate representation of the reviews for Flying Over the Precipice if many 
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of those reviews are unfavorable. To do so may be counterproductive for Universal Theatres, because 
2 unfavorable reviews would not effectively sell the movie to people who view the page shown in 
window 306, The information provided by Universal Theatres in its publications and on its web pages 
4 may not be wrong or incorrect, but at least in some situations, this information is likely to be slanted 

in a manner that is favorable to Universal Theatres. 
6 In the embodiment shown in Figure 4, the mformation provided in window 320 provides a 

revealing supplement to the information on the Universal Theatres page shown in window 306. The 
i information in window 320 therefore may be quite useful to a person contemplating going to a movie 
because the viewer will be able to consider a more representative sample of the reviews the "Hying 
10 Over the Precipice' is receiving* Universal Theatres, however, may prefer to keep unfavorable 
reviews from the viewer of its page when the reviews are generally unfavorable. (But in other 
12 situations or embodiments. Universal Theatres may not object, and may even encourage the 
communication of information of this type to the user,) 
£14 It may be possible for the user to go directly to the place on the network where the information 

Q shown m Figure 320 is found. However, at least in some situations, the user may not know where to 
*|46 find these reviews, and may not even know that there is a resource for such information. Yet the user 
- may in these situations know where to fmd the Universal Theatres* **Flying Over the Precipice** page 
ills that is shown in window 306. Universal Theatres may have heavily marketed the movie, and as a 
f : result, the user may. know the location on the network where information about the movie can be 
f^o found. Thus, at least in some cases, the user is more likely to go to the Universal Theatres page when 
1^' interested in a particular movie produced by Universal Theatres. Yet the information that the user will 
□2 find there may describe Universal Theatres* movies favorably* makmg an assessment of the 
entertainment value of a particular movie both difficult and potentially inaccurate. The supplemental 
24 information shown m window 320 may make such an assessment easier or more accurate. 

Figure 5 is a diagram showing seven computers, including computers 902, 904, and 906, 
26 connected to a network 910. Many more (or less) computers also could be present on the network. 

The network 910 could also be an internetwork such as that shown in Figure 2, or any other type of 
28 network. In the embodiment of Figure 5, the user operates a browsing program (i.e,, •'browser*') at 
computer 902 (referred to herein as the "^client" computer), and the browsing program is typically 
30 stored and executed on that computer. The browser is capable of retrieving resources from various 
computers on the network, such as from computers 904 and 906. Normally, inter-computer 
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communication takes place through a protocol such as HTTP, DCOM, HOP, or Java's RML Any 
2 other protocol could be used. 

Figure 6 is a flow chart illustrating the process diagrammed in Figure 5, At 942 in Figure 6, 
4 the browser executing on computer 902 in Figure 5 sends a request to computer 904 for a document 
stored on server 904. The document stored on the server 904 might be the **Flying Over the 
6 Precipice" document shown in Figures 3 and 4, and the computer 904 could be a web server on which 
that document is stored. The request for this document is shown in Figure 5 by the arrow 921. The 
8 web server 904 responds to this request at 944 by sending the requested document to the client 
computer 902. (See arrow 922 in Figure 5.) The browser executing at the client then displays the 
10 requested document (946). 

At 948 in Figure 6, the browser (or another program that works in conjunction with the 
12 browser) then sends information describing and/or identifying the displayed document to computer 906 
(arrow 923 in Figure 5). In the embodiment shown, the computer 906 differs from the server from 
'^14 which the browser retrieved the displayed document. A computer such as computer 906, may be 
. referred to in some embodiments as a ''reference server** because requests are sent to it to see if 
L46 supplemental information is available for a particular document on the network. Thus, it is used, at 
^ least in part, as a ""reference."* The information sent to computer 906 m the embodiment of Figure 5 
^^18 includes the server from wUch the displayed document has been retrieved (i.e., server 904), as well as 
the identity of the document or resource on that particular server that is being displayed at the client 
/^20 902. For the example of Figures 3 and 4, the server is the Universal Theatres, Inc. server and the 
^ specific resource on that server is the ''Flying Over the Precipice'' document. See title bar 308 in 
Figures 3 and 4. 

Upon receipt of this information from the client computer 902, computer 906 checks a table or 
24 a database of servers and documents to determine if there is supplemental information available for this 

particular document. The computer 906 then sends a response to computer 902 that indicates whether 
26 supplemental information is available for the identified document (i.e., the **Flying Over the Precipice" 

document), and if so, the computer 906 includes the supplemental information in its response. (See 
28 arrow 924 in Figure 5.) The browser (or the program operating in conjunction with the browser) then 

displays the supplemental mformatiion (954). In the embodiment of Figure 4, the supplemental 
30 information available for the "Flying Over the Precipice" document stored on Universal Theatres* web 

server is the reviews mformation shown in window 320 in Figure 4. This supplemental information is 
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sent to the client computer 902 (arrow 924) by the computer 906, and is displayed in window 320 
2 along with the **FIying Over the Precipice" document as shown in Figure 4. 

Figure 7 is another network diagram, and Figure 8 is an accompanying flow chart. Computers 
4 1002, 1004, and 1006, as well as others, are shown on a network 1010. The user operates the 
browsing program at the client computer 1002, and the browsing program is usually (but need not be) 
6 stored and executed on that computer. As in Figure S, the browser is used to retrieve resources from 
various computers on the network. At 1042 in Figure 8, the browser executing on the client 1002 
8 sends a request to server 1004 for a document stored on resource server 1004 (see arrow 1021 in 
Figure 7). Upon receiving this request, the server 1004 sends the requested document to the client 
10 1002 (arrow 1022 in Figure 7), and the document is displayed at the client 1002. At 1048 in Figure 8, 
the browser^ or some other program that operates with the browser, sends mformation identifying the 
12 document displayed at the client to the server 1006. This computer 1006 checks to see if supplemental 
information is available for the identified document, and then sends to the client 1002 information that 
p4 indicates whether supplemental mformation is available for the identified document, and if so, where 
53 that supplemental information can be found. If there is supplemental information available for the 
tji6 document displayed at the client computer 1002, the client then sends a request for the supplemental 
>i information to the computer identified by the mformation that the client receives from the reference 
fjis server 1006. In the example of Figures 7 and 8, computer 1006 identifies computer 1008 as havmg 
supplemental mformation, so this request from computer 1002 goes to computer 1008 ^ee arrow 102S 
R20 in Figure 7). (The conqmter 1008 may be referred to in some embodiments as the ''supplemental 
JJV information* server.) The computer 1008 responds by sending the supplemental information to the 
02 client 1002 (arrow 1026), and the client presents this supplemental information to the user, typically by 

displaying the supplemental information on the screen. 
24 Figures 9 and 10 illustrate a network diagram and accompanymg flow chart in an other 

embodiment. In Figure 9, the browser at the client 1102 sends a request for a document to the server 
26 1104, and this server responds by sending the requested document to the computer 1102 (arrows 1121 
and 1122 m Figure 9). The client then sends information identifying the document to the reference 
28 server 1106 (arrow 1123). The reference server 1106 then determines, by accessing a database or 
look-up table, whether the identified document has supplemental information available for it (1152). If 
30 it does, it sends a message to computer 1108, directing that computer to send the supplemental 
information to the client 1102. The supplemental information is then sent to the client by the computer 
32 1108. If the server 1106 were to determine at 1152 that there is no supplemental mformation available 
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for the document, the server 1106 would respond to the client computer 1102 by informmg the client 
2 computer 1102 that no supplemental information is available for the displayed document. 

Figures 11 through 14 illustrate embodiments of the present invention where the client 
4 computer 1502 has more than one process executing on it. In one embodiment, one process is a 

browser 1520 or document display program, and the other process is a program, applet, thread, or the 
6 like (hereinafter ""program 1525'*) that coordinates the display of the supplemental information in the 

manner herein described. These two programs commumcate through an mterprocess communication 
8 protocol, such as the Dynamic Data Exchange (DDE), OLE, ActiveX, CORBA, or JavaBeans 

protocols. Other cooununication protocols or component architectures are or will become available 
ID and perhaps widely used, and it should be understood that they are also applicable to the present 

invention. 

12 Figure 12 is a flow chart illustrating the process diagrammed in Figure 11. At 1550, the client 

computer first sends to the web server 1504 a request for a particular document, which is then serviced 
Q4 by the web server 1504 by sending the requested document back to the client 1502, The browser 
Q program 1520 informs the program 1525 of the identify of the document that was just requested and 
^16 displayed (1554). The program 1525 then sends information to the server 1506, inquiring whether 
2 supplemental information is available for the displayed document (1556). The server 1506 responds by 
|48 either informing the program 1525 of the location of supplemental mformation available for the 
identified document or by mforming the program 1525 that there is no supplemental information 
l^^o available for the displayed document (1558). If supplemental information is available for the displayed 
^ document, the program 1525 directs the browser to retrieve the supplem^ital information (e.g., from 
Qi'-' server 1508) and display it on the screen with the displayed document (1562, 1564, 1568, and 1570). 

Figure 13 is a network diagram of another embodunent of the present invention, and Figure 14 

24 is a flow chart illustratmg the process diagranuned m Figure 13. As shown in Figure 13, the browser 
program 1530 executmg on the client computer 1502 first retrieves from the web server 1504 a given 

26 document or resource, and the browser 1530 informs the program 1535 of the identity of the retrieved 
document (1572, 1574, and 1576 in Figure 14). The program 1535 then sends the identity of the 

25 retrieved document to the server 1506, and in response, receives the location of where any 
supplemental information for the retrieved document can be found (1578 and 1580 in Figure 14). The 

30 program 1535 then retrieves the supplemental information and presents it to the user, typically by 
displaying it on the screen. The embodiment of Figure 13 thus differs from that of Figure 11. One 
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difference is that unlike program 1525, program 1535 of Figure 13 displays the supplemental 
2 information rather than directing the browser to display that content. 

In Figures 11 to 14, the programs 1525 and 1535 may be informed of the identity of the 
4 document presented to the user by the programs 1520 and 1530 through interprocess communication. 
It may be appropriate in other embodiments, however, for the program 1525 (or the program 1535) to 
6 access the network connection or network stack or operating system software directly, and analyze the 
information or packets being passed over the network. The data on the network may need to be 
s analyzed and/or decoded to decipher the necessary information about the identity of the document 
presented to the user« It should be understood that any known or hereafter developed technique for 
10 identifying the content being presented to the user could be used, and such techniques may also be 
applicable to the present invention. The present invention need not be lunited to die interprocess 
12 conununication techniques described in connection with Figures 11 to 14. 

Figure 15 is a flow chart that illustrates the operation of a server computer such as computer 
p44 1506 in the embodiments diagranuned in Figures 11 and 13, In Figures 11 and 13, a server process 
C executes on the computer 1506 to provide information to client computers about where supplemental 
jj6 information relating to network resources can be found. At 1710 and 1712 of Figure 15, the server 
3 process waits for a request from a client computer. Upon receiving a request, the serv^ process looks 
■y^z up the document specified m the client's request in a look-up table or some other data structure (1714). 
I , If the server does find at 1714 and 1716 tiiat there is supplemental information for the specified 

n^o document, the client computer is so informed at 1718, and the client computer is also informed at 1720 
0- where the supplemental information can be found. Where there is no supplemental information for the 
52 specified document, the reference server informs the client that no entry exists for the specified 
document, which the client understands to mean that there is no supplemental information for the 
24 specified document. The loop 1710 and 1712 is then reentered. 

Figure 16 is a sunplified representation of a database or look-up table such as that referred to 
26 at 1714 in Figure 15. As can be seen from this table, the ''Flying Over the Precipice* document that 
is stored on the ^Universal Theatres" server has an entry at 1751 specifying that supplemental 
28 mformation for this document can be found at the server called ''reference" and within the document 
called ''flying over the precipice." This is the document displayed m window 320 in Figure 4. There 
30 are also other entries 1753 for the "Flying Over tiie Precipice" document m tiie table of Figure 16, 
which means that there are a few instances of supplemental information for the '^Flying Over the 
32 Precipice"* document 
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There are entries for other documents in Figure 16, such as the ^'index* document from the 
2 ''Hunan Taste" server. This document has supplemental information available, and that supplemental 
information is contained within the document "metro pages quote" and is stored on the ^oriental 
4 specialties" server. Similarly, the "dine-in menu" document on the "Hunan taste" menu also has 
supplemental information vi^ithin document "dine-in menu" at the "oriental specialties" server. By 
6 referring to the entries in the look-up table, the server is able to determine whether supplemental 
mformation is available for any given document. In the embodunent shown in Figure 16, if there is no 
8 entry in the look up table for a document, no supplemental information is available for that document. 

In some embodunents of the present invention, each time a new document or resource is 
10 presented to the user (e.g., in window 306 of Figure 3), a request for supplemental information is 
always initiated. In other embodiments, the client computer only occasionally sends a request over the 
12 network to determine whether there is supplemental information for the document displayed or 
otherwise presented at the client computer. Figure 17 is a flow chart illustrating a process in which 
id4 the system waits at 1302 until the user requests that a new document be displayed. When the user 
C makes such a request, the requested document is displayed at 1306. If the requested document is not 
yl6 from the same server as the previous document, supplemental information relating to a previous 
document is removed from the display at 1309. A message is then sent over the network to a reference 
WIS server so that the reference server can determine whether supplemental information is available for the 
7; displayed document (1310, 1312). If so, the supplemental information is retrieved and displayed. 
R20 However, if the displayed document is from the same server as the previous document, or if there is no 
supplemental information for the displayed document, the waiting loop 1302 is entered. 

- -j-w,- - ■ 

Qi The embodiment of Figure 17 thus operates to check the reference server for supplemental 

mformation only where the user requests a document that is stored on a server that is different from 
24 that of the previously-displayed document. The amount of network trafBc generated by repeated 

requests to the reference server is reduced in this embodiment because the requests are generated only 
26 when the user accesses to a new server. In a modified version of this embodunent, the reference 

server is checked only where the domam has changed, 
28 Figure 18 is a flow chart illustratmg a process m another embodiment of the present invention. 

In Figure 18, if it is determined at 1408 that the requested document is not stored on the same server 
30 as the previous document, then a reference server is checked for supplemental information for the 

displayed document (1410). If supplemental information is available, that mformation is retrieved and 
32 displayed (1412)* In addition, the reference server is checked for supplemental information for other 
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documents stored on the document server, and this information is stored on the client computer (1416). 
2 The loop 1402 is then entered. If at 1408 the requested document is from the same server as the 
previous document, the locally stored information for other documents stored on the same server is 
4 analyzed. This information may have been previously stored at 1416, and if it reveals that 
supplemental information is available for the displayed document, the supplemental information is 
6 retrieved and displayed at 1428. 

Thus, in the embodiment of Figure 18, that portion of the look-up table or database (or 
8 whatever data structure is used) that corresponds to a particular server is downloaded to the client the 
first time that the client computer retrieves a resource from a particular server. Thereafter, the client 
10 need not use the network to determine whether supplemental information is available for any other 
documents stored on that same server because the information necessary to make this determination is 
12 Stored locally on the client. This embodiment may be more efficient where the cost of making multiple 
requests over the network is high and the information that needs to be downloaded each time a new 
14 server is encountered is not too voluminous. 

In Figure 19, a window 506 from a document retrieval program or a browser is shown on the 
"16 screen 504, The title bar 507 identifies the server from which the document was retrieved (i.e., the 
server controlled by ""Hunan Taste, Inc.*"), and the identity of the document (i.e., ""index"). This 
V is ''index'* document relates to a restaurant named ""Hunan Taste,'' located in a hypothetical city's 
""Redwood District." This document provides links to information about the Hunan Taste restaurant's 
iao daily specials and dine-in and carry-out menus, which can be retrieved by the user by selecting one of 
the display elements 532. A delivery order from Hunan Taste can also be placed by selecdng display 
element 534. A banner advertisement 512 promotes an establishment called ""Jerico's Tavern," which 
is located near Hunan Taste. In this embodiment, Jerico's Tavern advertises on Hunan Taste's page 
24 because it seeks to attract patrons leavmg Hunan Taste after dining. Because Jerico's Tavern is not a 
direct competitor to Hunan Taste, Hunan Taste may permit (even encourage) Jerico's Tavern to 
26 advertise on the page shown in window 506. 

When the ""index" document from the Hunan Taste server is retrieved over the network and 
28 displayed m the window 506, as shown in Figure 19, the window 520 also appears on the display 
screen 504. The information shown in window 520 relates to a competing Chinese restaurant called 
30 ""Oriental Specialties." A person viewing the Hunan Taste page shown in wmdow 506 is likely to be 
mterested in gomg to a Chinese restaurant, so ""Oriental Specialties" has an interest in providing an 
32 advertisement to such a person. In some embodiments, however, Hunan Taste may not allow a 
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competing restaurant (i.e., Oriental Specialties) to advertise on the page displayed in window 506. 
2 Thus, Oriental Specialties may be unable to reach these potential customers through advertisement on 

Hunan Taste's pages. (In other embodiments, Hunan Taste may permit such activity.) 
4 The window 520 allows Oriental Specialties to conmiunicate with the person viewing the 

Hunan Taste web page displayed in window 506. These persons may be considering a visit to the 
6 Hunan Taste restaurant, or at least may be interested m Chinese food. In window 520, Oriental 
Specialties provides mformation targeted specifically to individuals viewmg the Hunan Taste page 
8 shown in window 506 by quoting a magazine article in which Oriental Specialties is favorably 
compared to Hunan Taste. This may be targeted and effective marketing for Oriental Specialties 
10 because the message displayed in the window 520 is likely to be seen by mdividuals looking for the 
very service that Oriental Specialties provides. In addition, the person viewing the Hunan Taste page 
12 may also be interested m seeing the information shown in window 520. Because this person has 
retrieved the Hunan Taste page, he or she likely is interested in Chinese cuisine, yet may not know 
H4 about the Oriental Specialties restaurant. Thus, from the user's perspective, the window 520 may 
provide useful, relevant, and appreciated information that might not otherwise be seen when viewing 
hM the Hunan Taste page alone. 

J; In Figure 20, the ""index" document from the Hunan Taste, Inc. server is displayed in window 

Hs 606, and in this embodunent, a task bar 608 is also shown on the display screen 604. This task bar 
608 has buttons 612 th^ can be used to select particular programs or stores of information. In Figure 
^'^0 20, supplemental mformation is displayed m response to the user selecting (e.g., through an input 
k device) the display element 610. 

^»£2 In Figure 21, the user has selected the display element 610, causmg supplemental information 

similar to that shown in window 520 in Figure 19 to be displayed in the box 607. Although the button 

24 610 is provided on the task bar of Figures 20 and 21, it need not be, and such a button or other 
functionality could be provided, for example, through a menu structure, or through an icon elsewhere 

26 on the screen. 

In another embodiment of the present invention, shown in Figure 22, supplemental information 
23 relevant to the mformation displayed in a browser window 806 is displayed in a scrolling window 810 
shown on the taskbar 808. The supplemental mformation may be scrolled in window 810 where the 
30 wmdow 810 is quite small. 

Figure 23 shows a window 1806 on a display screen 1804. As indicated in the title bar 1808 
32 for window 1806, the document ^widget purchase page" from the XYZ Corporation server is 
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displayed in window 1806, This page may be used to purchase a specified quantity of ''widgets,* 
2 which are products manufactured and sold by XYZ Corporation, A person browsing this page can 
purchase a quantity of XYZ Corporation Widgets by entering a credit card number (or other financial 
4 account number) and specifying the manner in which the Widget(s) should be shipped, (This 
information could also be provided automatically.) Once the requisite mformatlon is completed by die 
6 user, the user selects button 1820 to place the order and to process the transaction. Window 1819 is 
shown in Figure 23 to illustrate how the display screen 1804 may appear when supplemental 
g information is available for a particular page but» because of limitations in network resources or 
bandwidth^ has not yet been fully retrieved over the network and rendered on the display. The 
* 10 window 1819 in the embodiment of Figure 23 informs the user that there is supplemental information 
for the XYZ page shovm in Figure 23, and acts as a ^'place holder*" while the supplemental mformatlon 
12 is being retrieved over the network or rendered on the display. 

Once the supplemental information is retrieved over the network, the display of Figure 23 is 
% 14 updated to that shown in Figure 24. Window 1820 now mcludes an advertisement from ABC 
^t- International, Inc, in which that entity offers to sell widgets for a price that is lower than those sold 
,ii6 by XYZ Corporation. Thus, as shown in Figure 24, despite the fact that ABC International, Ltd. is a 
% direct competitor to XYZ Corporation, ABC is effectively able to advertise m a manner closely 
^ 18 associated witii XYZ Corporation's pages, and even at XYZ's pomt of sale. This can be a very 
effective scenario for advertisement, precisely because the advertisement is so pertinent and of interest 
20 to the user viewing this particular XYZ Corporation page. 
^ If tiie user selects the advertisement ui window 1820, the display is, in one embodiment, 

C22 updated to that shown in Figure 25. Figure 25 is a point of sale page for ABC International, where die 
user can specify the quantity of widgets that he or she wishes to purchase, and can purchase them at 
24 this page. Thus, the user may be able to move very efficientiy from the point of sale at the XYZ 
Corporation page to the point of sale page at a competmg manufacturer, and compare prices and/or 
26 features and selection very efficiently, quickly, and easily. In another embodiment, a page for ABC 
International is displayed in a separate wmdow or other display area, leaving the XYZ page at least 
28 partially visible on the display. 

As illustrated in the look-up table of Figure 16, some network resources may have more than 
30 one supplemental information document or resource that is relevant to it. For example, as shown in 
Figure 16, the widget purchase page on XYZ Corporation's server has tiuree different entries in tiie 
32 look-^p table in Figure 16. One way in which this situation is handled is to simply choose a single 



11:39 M,»viBBlNrKim 



15. 



o 



o 



entry for a given document or resource and provide only that supplemental information document. 
2 Selection of the entry to be used can be done randomly, or through a weighted (or evenly-weighted) 

average for each of the available entries. Another method is to display a large number or all of the 
4 entries^ 

In another method of handling such a situation, illustrated in Figure 26a, the three 
6 supplemental information documents are rotated in the window 1820 m Figure 24. Each advertisement 
may be paused for a preprogrammed period of time, which may differ for each advertisement Figure 
8 26a shows the order in which each of the three advertisements are displayed in the window. This 
method allows multiple third parties to provide supplemental information that is relevant to smgle 
10 page. The amount of time that the advertisement or other message is displayed could depend on the 
rate p^d by the advertiser. It could also depend on the number of advertisers or mformation provide 
12 that wish to provide information in this manner. In the embodiment of Figure 26a, when the time 
period for the third supplemental information document (i.e., JSO Technology) is completed, the order 
pi4 repeats. 

When supplemental information is presented in the manner illustrated in Figure 26a, where 
iJ6 each is allocated a portion of time on the display, the user may have difficulty selecting supplemental 
^2; mformation when the time allocated for one or more instances of supplemental information is short. 
HIS For example, if each of the three mstances of supplemental information illustrated in Figure 26a is 
displayed on the screen for only three seconds, the user may have to act quickly in order to move the 
fiko pointing device to the window 1820 (or perform some other method of selecting the information in the 
h] wmdow 1820) m Figure 24 when the desired supplemental information is displayed or otiierwise 
Q2 presented to the user. If the user waits too long, the next instance of supplemental mformation will be 

"hat 

rotated into the window and the prior mstance will be lost (at least temporarily). This problem can be 
24 addressed by suspending the timer (or some other similar mechanism) that keeps track of the 

supplemental information during the time that the user is moving the cursor. For example, while the 
26 user is substantially continuously movmg the cursor 1801 (or o&erwise activatmg the input device) on 

the screen in Figure 24, the supplemental mformation displayed in window 1820 will suspend or delay 
28 the process of rotating the next mstance of supplemental information into the window 1820. Thus, if 

the user starts moving the cursor 1801 on the display just prior to the time for the instance of 
30 supplemental information displayed in tiie window 1820 to be changed, tiie supplemental information 

may remain until the user stops moving tiie cursor. This provides a more forgiving envuronment for 
32 selecting transient display elements such as the window 1820. 
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Figure 26b is a flow chart illustrating an implementation of such a procedure. At 2650, 
2 supplemental information is presented to the user (e.g., displaying information on the display screen, 
playing an audio clip). At 2652, a determination as to whether the supplemental information that is 
4 currently being presented to the user should be replaced with other supplemental information is made 
(e.g., determining if a predetermined aniount of tune has elapsed, or if some other condition is 
6 satisfied). If not, the process of Figure 26b checks to see if the mput device is activated at 26S4. If 
the device is not activated, the condition at 2652 is again tested. This loop continues as long as the 
8 user's input device (e.g., pointing device, keyboard, voice recognition logic) is not activated, and the 
condition at 2652 is not satisfied* When the input device is longer activated, a loop at 2654 continues 
10 until that mput device is no longer active. And when a determination is made that the supplemental 
information should be replaced, new supplemental information is selected (e.g., as described in 
12 connection wifli Figure 26a) at 2656, and then presented to the user at 2650. 

In Figure 27, the window 2006 includes within it an area 2009 in which supplemental 
14 information is displayed. This area 2009 is integrated into and may be part of the window 2006. A 
g button 2011 may be used to hide and unhide the area 2009. In tiie embodiment shown, selection of the 
16 button 2011 when the supplemental information area 2009 is displayed will remove from the window 
N from the area 2009. Thereafter, the button 2011 will still be visible, and selection of tiiat button will 
Tis restore the area 2011. In otiier embodiments, the area 2009 may be positioned in many different areas 
and in many different ways. For example, the area 2009 could be configurable within the browser, 
fU20 and retrievable through a keyboard conunand or menu selection. 

% A flow chart of a process for presenting a supplemental resource or supplemental content to a 

Q22 user is illustrated in Figure 28. The system waits at 1202 until the user requests that a network 

resource be presented. At 1204, the presentation of any supplemental resource(s) relating to an earlier 
24 presented resource may be discontinued. (In another embodunent, the presentation of such a resource 

may be continued.) The requested resource is then retrieved and presented to the user at 1206. The 
26 presentation of this resource may involve an animation, the execution of a program, the playing of a 

video or audio clip, the display of a text-based document, or any combination of these or other 
28 techniques. At 1208, the system determines whether there are supplemental resource(s) available for 

the currently presented resource. As described previously, in one embodiment, this may involve a 
30 request sent to a reference server tiiat is different from that from which the currently presented 

resource has been retrieved. Alternate procedures could also be followed. If supplemental resources 
32 are available at 1210, at least one of these resources is retrieved at 1211 and presented to die user at 
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1212, These resources may be a computer program^ a video or audio clip (or both) or any other form 
2 or type of content or multimedia. 

In Figure 29, a browser window 2901 is shown on a screen, and a page from the **Hunan 
4 Taste, Inc*** server is rendered in the browser window 290 L On the task bar 2907 is an icon, button, 
or display element 2905. In Figure 30, the display element 2905 of Figure 29 has been selected with 
6 the cursor 2903, and the appearance of the display element 2903 has changed. In the embodiment 
shown, the display element 2903 has changed shape and is shaded, but any other visual or other 
8 mdication technique may be used. After a period of time, the display is further updated to that of 
Figure 31« where a window or area 3201 is displayed on the task bar 2907. Within the area 3201, 
10 various display elements 3203* 3205, 3207, and 3209 are displayed. 

Each of the display elements 3203» 3205, 3207, and 3209 represent a ^e of supplemental 
12 information relating to the content or information displayed in window 290L In the embodiment 
shown, the presence of four display elements 3203, 3205, 3207, and 3209 means that four different 
34 types of supplemental information are available for the content rendered in the window 290L For an 
C embodiment like that of Figure 31, if only one type of supplemental information were available for the 
1^16 coatent rendered in window 2901, only one display element would be displayed in the box 3201. In 
H another embodiment, however, a display element may be present for each type of supplemental 
J8 information, whether or not that type is available. In such an embodiment, display elements may be 
modified or highlighted when supplemental information of the corresponding type is actually available. 
;;20 In Figure 32, the display has been updated foUowii^ the selection of display element 3203 with 

!r the cursor 2903. The selection of the display element 3203 causes supplemental information of the 
type represented by display element 3203 to be displayed in the window 3303 m Figure 32. The 
display element 3203 represents supplemental information relating to competing services, or services 
24 that compete in some way with a given service provider. Because the service provider that is the 
subject of the content rendered in the window 2901 in Figure 32 is the Hunan Taste restaurant, 
26 competing services may be, for example, other restaurants. And as shown m Figure 32, window 3303 
displays supplemental information about a competing restaurant, Oriental Specialties. A display 
28 element 3305 is shown m the window 3303. This display element 3305 indicates which type(s) of 

supplemental mformation are being provided in the window 3303. 
30 Figure 33 is a network diagram illustrating the network activity underlying Figures 29 to 32. 

At computer 902, the user operates the browser or document viewing program represented by the 
32 window 2901 m Figure 29. The computer 902 sends a request for a document to the computer 904, 

18. 



o 



o 



which is the Hunan Taste, Inc. server. In response, requested document is sent by the computer 904 to 
2 the computer 902. See the arrows labeled in Figure 30. At this point, the display is as shown in 
Figure 29, 

4 When the display element 2905 is selected in Figure 29, the display is updated to that shown in 

Figure 30, and a request is sent by the computer 902 to computer 906 for information about the types 

6 of supplemental information available for the content rendered in window 2901. The display is 
updated to that shown in Figure 30 to indicate to the user that information describing the ^es of 

8 supplemental information av^lable for the content of window 2901 is .being retrieved over the 
network. Because of network or other limitations, the retrieval of this information may take time. 

10 Computer 906 responds to the request made by computer 902 by sending information about the types 
of supplemental information (if any) available for the content rendered in window 2901 . See the arrows 

12 labeled *'2'* in Figure 30. When the supplemental information types are retrieved, they are 
communicated to the user, such as in the manner shown in Figure 32. In some embodiments, the 
computer 906 may also send the location and identity of supplemental information for one or more 
u information types, thereby making this information available for later use. 

J^l6 When the user selects the supplemental information type in Figure 32, supplemental 

^ information of the selected type is retrieved over the network (e.g., from computer 908). See the 

:.y.-.i . ■ 

s^l8 arrows labeled in Figure 30. The location of this supplemental information may have been 
identified when the types of supplemental information were previously retrieved from the computer 
R.20 906. (See arrow *2'' of Figure 30.) If not, however, the location of the supplemental information may 
:^ ; be retrieved over the network from computer 906 (or from another computer on the network) before 
^422 the supplemental information is actually retrieved from computer 908. 

Figure 34 shows numerous display elements, each of which may rq>resent a different type of 
24 supplemental information in the window 3201 of Figures 31 and 32. Display element 341S was the 
display element selected in Figure 33, and it represents supplemental information for competing service 
26 providers. For a page or site relating to a restaurant, supplemental mformation from a competing 
service provider may be information about another restaurant. For a service provider such as, for 
28 example, a landscaping service, supplemental information from a competing service provider may be 
information or content from anotiier landsc^ing service, or perhaps a lawn mamtenance service. 
30 Since there are service providers for ahnost every type of service, a display element of this nature can 
be used in a wide variety of other contexts, and m many situations. 
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Display element 3413 represents supplemental information or content relating to a competing 
2 product supplier. Supplemental information of this type for a page involving bicycles, for example^ 
may involve information about another bicycle manufacturer or another bicycle distributor. This 
4 display element may represent supplemental information relating to any type of product. A display 

element of this nature can be used in a wide variety of other contexts* and in many situations. 
6 Display element 3411 represents supplemental information or content from a competing 

information supplier. This display element may be pertinent to a page from a news or business 
8 information provider. Selection of display element 3411 may cause information or content to be 
presented to the user that is published by a competitor of the publisher of the mformation aheady being 
10 presented to the user. For example, for a page from a sports information site that publishes the latest 
sports scores and highlights, supplemental information of this type may be mformation about a 
12 competing sports information site. A display element of this nature can be used in a wide variety of 
other contexts, and in many situations. 
f X4 As described, the display elements 3415, 3413, and 3411 described above present information 

y from or about a competitor to the subject of the information or content that is otherwise being 
k46 presented to the user. The display element 3415 represents competing service providers, and may be 
^ useful at least when the user is viewing or is being presented with content relatmg to a particular 
yis service provider. The display element 3413 represents competing product information, and may be 
^ useful at least when the user is viewmg or is bemg presented with a page describing a particular 
."^^0 product. And the display element 3511 represents competing information, and is useful at least when 
the user is being presented with content or information of a particular type (e.g., news or business 
%22 mformation). 

Display element 3409 represents supplemental information relating to price, and may be used 
24 to mdicate that price mformation is available for the content or page being viewed by the user. For a 

page offering a particular product for sale, supplemental mformation of this type may describe a 
26 competitor that offers the same or a similar product at a reduced price. Alternatively, for the same 

page, supplemental mformation of this type may be information from an entity that provides cost 
28 analysis or cost commentary for the offered product or for the company offering the product. Another 

example of the use of this type of supplemental information is shown in Figure 24. A display element 
30 of this nature can be used m a wide variety of other contexts, and in many situations. 

Display element 3407 represents a type of supplemental mformation that relates to the actual 
32 information or content being presented to the user. For example, for a movie or video, display 
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dement 3407 may represent a review of that movie or video. For a news page, display element 3407 
2 may represent a review or critique of the publisher of the news page, or of the particular news page 
itself. This type of supplemental information may differ from that of, for example, display element 
4 341 1 where it provides information about the content itself, rather than similar, competing content A 

display element of this nature can be used in a wide variety of other contexts, and in many situations. 
6 Display element 3405 represents supplemental information of a type that is information about a 

given product, service or instance of mformation* For a given product or service, supplemental 
8 information of the type represented by display element 3405 may be a review or critique of that 
product or service. See, e.g.. Figure 4. In another example, for a product that requires assembly, 
10 supplemental information of this type could include instructions on how to assemble the product. A 

display element of this nature can be used in a wide variety of otiier contexts, and in many situations. 
12 Display element 3403 represents supplemental information about a service. For example, for a 

page describmg or offering for sale a vacuum cleaner, the display element 3403 may represent 
I44 information about a home or office cleaning service. Or for a page describing how to select winners in 
Q the stock market, display element 3403 may represent information from a discount brokerage house or 
p6 a electronic stock trading service. A display element of this nature can be used in a wide variety of 
2 other contexts, and in many situations. 



a page or video that describes bow to construct landscape retainmg walls, display element 3401 may 
fl20 represent information from the manufacturer or distributor of a tool that easily splits the retaming wall 

blocks, as may be required when constructing such a retaining wall. A display element of this nature 
C22 can be used in a wide variety of other contexts, and m many situations. 



The foregoing display elements are described merely to illustrate the various types of 
24 supplemental mformation that may be made available, and these categories are not meant to be 

exhaustive. And they may not be rigidly defined in every embodiment. Further, different schemes for 
26 categorizing supplemental information can be used, and it should be understood that any such alternate 

schemes for categorizing supplemental information may be applicable to the present invention. 
28 Figure 35 is a flow chart of a process similar to that illustrated in Figures 29 to 32. At 3501, 

the user retrieves a network resource over the network. The network resource is then presented to the 
30 user at 3503. This may involve the content bemg displayed for the user, or it may involve an audio . 

presentation or any other type of multimedia presentation. The user then requests at 3505 information 
32 about die types of supplemental mformation. This request can be made by selecting a button with a 
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pointing device (e.g., display element 2905 in Figure 31), or this request could be made through any 
2 other input device (e-g., voice recognition). The request at 3505 causes information about the types of 

supplemental information available to be retrieved over the network at 3507, and communicated to the 
4 user at 3509. In one embodiment, the types of supplemental information available are communicated 

to the user through display elements as are shown m Figures 31 and 32, 
6 Still referring to Figure 35, the system loops until the user selects a type of supplemental 

information at 3511. When such a selection is made, supplemental information of the selected type is 
8 presented to the user at 3513* This supplemental information may be retrieved over the network, or, if 

it was akeady retrieved over the network, it may be retrieved from local storage. 
10 Figure 36 is a flow chart illustrating an alternate process. At 3601, the user retrieves a 

network resource over the network. The network resource is then presented to the user at 3603. At 
12 3605, information describing the available types of supplemental mformation is retrieved over the 

network, without waiting for the user to request this information. The user is mformed of the types of 
34 supplemental information available at 3607, and supplemental information is presented to the user at 
Q 3611 when the user selects a type of supplemental mformation at 3609. 

jTi6 Figures 38a and 38b illustrate display screens in an embodiment in which rendered in the 

'^i browser window is supplemental information that relates to an earlier page rendered in the browser 

ff\ ■ 

i^as window. In other words, in one embodiment, supplemental mformation relating to the previous page 

is provided when the user accesses another a site on the network that acts as a server for supplemental 
pJ20 information. In Figure 38a, the browser window 3801 shows a page from the Hunan Taste, Inc. 

server. Supplemental information is provided to die user about the Hunan Taste ps^e shown m 
022 wmdow 3801 when the user conununicates to the browser program the identity and/or location of a 

server for supplemental information. (The identity and/or location of such a server could be 
24 communicated to the browser a number of different ways, such as by typing it mto a text box witMn 

the browser program, selecting such a server from a pull-down nienu, selecting an display element or 
26 link within the browser window that corresponds to the supplemental information server, or any other 

way known in the art.) 

28 When the identity and/or location of such a server is provided to the browser, the browser 

communicates to that server the page or resource that is currentiy bemg presented to the user (i.e., the 

30 Hunan Taste page). The server for supplemental mformation evaluates this request, and then serves 
supplemental information. This supplemental mformation is then presented m the window 3801 as 

32 shown in Figure 38b, replacing the content in wmdow 3801 in Figure 38a. 
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Figure 37 is a flow chart of a process similar to tibat described in connection with Figures 38a 
2 and 38b» At 3701, the user of a browser program (or a similar program) retrieves a network resource, 
which is termed network resource "alpha" in Figure 37. This network resource alpha is retrieved 
4 from a server (or servers) on the network. The resource alpha is then presented to the user at 3703. 

Thereafter, the user goes to a supplemental information site on the network (3705), and the identity of 
6 the network resource that was previously presented to the user at 3703 (i.e., ^network resource alpha") 
is conununicated to the supplemental information site (3707). Based on this mformation, the 
8 supplemental information site provides supplemental information at 3709 about the previously- 
presented network resource (i.e., network resource alpha). This supplemental information is presented 
10 to the user at 3711. 

Figure 39 illustrates a simplified display screen in another embodiment of the present 
12 invention. In Figure 39, the display element 3905 m wmdow 3901 has been selected with the cursor 
3905, causing wmdow 3907 to be displayed. The window 3907 provides supplemental information of 
^^14 the **competing service" type. Competing service information from three different competitors is 
C shown in window 3907 (Oriental Specialties, Thai Taste, and The King*s Kitchen). Information from 
pl6 each of the three different competitors is displayed in its own frame or sub-window 3909, 3911, and 
\ 3913. An alternate implementation may have three or more windows, one for supplemental 
^^18 information from each of the competing restaurants (or otiier entities). 

Figure 40 is a diagram of a network where supplemental information from more than one 
r;20 source is presented to the user. Initially, the user at computer 902 requests and then retrieves a 
network resource from server 904. This request and response from the server 904 is indicated by line 
'ZT^ 4001. The identity of the resource retrieved from computer 904 is then communicated by computer 
^ 902 to server 906, which responds by identifying the location of supplemental information about the 
24 resource retrieved from server 904. This communication and response is represented m Figure 40 by 
line 4002. In flie embodiment shown, the identifying information received by computer 902 from 
26 server 906 points to servers 920, 922, and 924. Thus, supplemental mformation is retrieved by 
computer 902 from each of tiie servers 920, 922, and 924, as is indicated by tiie Imes 4003, 4004, and 
28 4005. In this embodiment, supplemental information is distributed throughout the network, and it is 

retrieved by the client computer from a number of different servers. 
30 In an embodiment that differs from that shown in Figure 40, supplemental information from or 

relatmg to more than one source could be stored on a single server* This would allow some, perhs^s 
32 all, of the supplemental information to be retrieved from the same server. 
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In Figure 41, window 4101 displays information relating to the hypothetical Acme Electronics 
2 Corporation. Acme Electronics may manufacture or sell a large variety of products, and only a 

general page from Acme Electronics is displayed in window 4101. Window 4102 displays a number 
4 of display elements representmg different Qrpes of supplemental information available for the Acme 

Electronics server. When cursor 4104 selects display element 4103, which represents supplemental 
6 information relating to competing products, another window 4103 appears. The wmdow 4105 displays 

six different categories of products that the user can select. These categories r^resent products or 
s categories of products that are manufactured and/or sold by Acme Electronics Corporation. 

When the user selects one of the products (or categories of products) m Figure 41, 
10 supplemental mformation that is from the selected category is presented to the user. In Figure 42, the 

user has selected the "widgets'* category in window 4105 by selecting the ^'widgets'* text in the 
12 window 4105. This causes the window 4110 to be displayed, in which supplemental information for 

three widget manufacturers or distributors that compete with Acme Electronics Corporation is 

presented. 

C Because of the nature of some types of networks, it may be difficult to determine which 

ij^s document from a server is being retrieved by a client computer or presented to a user at a client 
^: computer. In other words, for embodunents such as those described in connection whh Hgures 11 to 
m 14, even where it is possible to determine which computer or server is being accessed on the network 
(through the use of a domam name or IP address), it may be difficult to accurately determine which 
iiio resource or resources on that computer are being accessed. For example, where documents are 

c „ ■ . 

r|j generated dynamically by the server, they may not have a consistent name or URL. Also, encryption 
42 techniques or the like can used to make determination of the nature of the document being presented to 

the user difficult. Sunilarly, documents could be continually modified, at least slightly, to make 
24 consistent identification and differentiation from other documents difficult. In addition, program 1520 

or 1530 may not be capable of providing the identity of the document being retrieved or presented. 
26 Thus, particularly where the person or entity in control of a server wishes to make accurate 

identification of a resource on the server difficult, the identity of the specific resource or document that 
28 is being presented to the user may be difficult to determine. A menu such as that shown in Figures 41 

and 42 may be useful in such a situation because it allows die user to select which type of information 
30 he or she is seeldng at a particular site. Thus, one at least partial solution is to provide a menu so that 

the user can select the ^e of supplemental information that he or she wishes to see. 
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Figure 43 shows an embodiment similar to that of Figures 41 and 42, but where a limited 
2 number of categories of products are displayed in a scrolling window 4105. In the wmdow 4105 in 
Figure 43, the categories are scrolled through the window so that only a limited number categories are 
4 displayed at a time. The marker 4108 marks the position in the list of categories. When the end of the 
list is approached, this marker 4108 moves toward the bottom of the slot 4115, When the end of the 
6 list rolls over to the front of the list, the marker 4108 moves to the top of the slot 4115. The visual 
indicator 4109 marks where the list begins repeating. This embodunent takes a small amount of screen 
8 real estate, yet allows the user to select from a large list of categories without searching for the desired 
category. In a manner similar to that described in connection with Figures 26a and 26b, the categories 
10 in the window 4105 may, in some embodiments, discontinue scrolling when the cursor is being 

continually moved on the display. 
12 The menus of Figures 41 to 43 are shown in connection with various implementations of the 

present invention, but it should be understood that other types of menus, perhaps having additional 
}44 levels, could be used where ^propriate. Further, the menus shown in Figures 41 to 43 are merely 
£\ illustrative, and it should be understood that many other menu structures or user interfaces known in 
vi6 the art or hereinafter developed may be applicable to the present invention. 

In Figure 44, the window 4405 displays information relating to the Acme Electronics 
1^48 Corporation m a manner similar to that shown in Figure 41. A display element or button 4401 is 
^ . shown on the task bar 4409. The user selects button 4401 when he or she wishes to see categories of 
Hio supplemental information. In Figure 44, the user has selected display element 4401, thereby causing 
window 4403 to be displayed as shown in Figure 44. This window 4403 communicates categories of 
fn products and services avsulable from Acme Electronics Corporation. The window 4403 also indicates 
the ^es of supplemental mformation available for each of the categories. For example, for the 
24 "Sprinters" category, supplemental information about services relatmg to printers manufactured or sold 
by Acme Electronics is available. Price information about the printers manufactured or sold by Acme 
26 is also available. In addition, information about printers manufactured or sold by competitors to Acme 
is available. 

28 In Figure 45, the user is selecting with the cursor 4511 the display element 4501, which 

represents a type of supplemental information in die '^widgets" category of window 4403. The display 

30 element 4501 that is being selected by the user is tiie competing product icon for tiie widget category. 
After the display element 4501 is selected, the display is updated to that shown in Figure 46, where 

32 supplemental information relating to competing suppliers of widgets is shown at 4601. In the 
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embodiment of Figure 46, the categories and supplemental infonnation type display elements remain 
2 on the screen while the supplemental information is presented to the user. In another embodhnent, 

shown in Figure 47, the competing product supplemental mformation is presented in the window 4701, 
4 but the categories and supplemental information type display elements, shown in window 4403 in 

Figure 45, are removed from the screen, 
6 Referring again to Figure 45, one or more display elements are shown for each of the 

categories shown m window 4403. Although Figure 45 has been described m connection with the 
8 selection of display element 4501, the user may select other display elements (e.g., 4502, 4503) for the 

widget category. Where other display elements are selected, supplemental information that 
10 corresponds to the selected display element would be presented to the user. Display elements from any 

of the other categories shown in wmdow 4403 could also be selected, which will result in the 
12 presentation of appropriate supplemental mformation for the selected category and supplemental 

information type. 

04 The system of Figure 45 could also be configured to allow the selection of the category itself, 

u without selection of any particular display element for the category. When the user selects the 
;ji6 category (e.g., by selection of the text describing the category), supplemental information of all types 
'4 may be presented to the user. Such an embodiment may be useful where the user wishes to see all of 
uM the supplemental mformation for a particular category. 

In Hgure 48, an application that presents audio content to the user is represented by window 
: f§Q 4805. The audio content is published by an entity called "WCAR,* and the audio content is a play-by- 
play broadcast of a "Cardinals'* football game. As shown in the window 4805, the Cardinals lead that 
^31 game 21-20 in tiie second quarter. In window 4807, a full motion video from the Universal Theatres 

hS^' ■■■■■■ 

server being presented. The video shown in window 4807 is the "^Flying Over The Precipice* movie. 
24 Thus, for the screen of Figure 48, audio content is presented to the user m window 4805, and video 

content is presented to the user in window 4807. A portion 4809 of the window 4805 is shaded or 
26 colored or otherwise marked so as to communicate to the user which of the window on the display is 

the '^active'* wmdow. Because the content relatmg to both of the windows 4805 and 4807 present 
28 audio to the user, it may be desirable to present audio from only one source. In Figure 48, the 

window 4805 is shown to be the active window, and it may have been placed m that condition by 
30 selection by the user (e.g., usmg the cursor 4803), by default (e.g., it may be the most recent window 

to appear on the screen), or in any other way. In the embodiment of Figure 48, audio from tiie active 
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window 4805 is presented to the user, while the audio from window 4807 is muted. The motion video 
2 in window 4807 may or may not continue. 

Still referring to Figure 48, the user selects the display element 4803 in the box 4801, which 
4 causes the display screen to be updated to that shown in Figure 49. In Figure 49, supplemental 
mformation about other competing content is provided in the window 490L The supplemental 
6 information displayed in window 4901 describes a live audio broadcast of a Gophers football game, 
where the Gophers are leading 14 to 3 with 12: 19 left. This information is related to the content being 
s presented to the user in window 4805, the acdve window in Figures 48 and 49. The window 4901 
also indicates that a commercial being broadcast in connecdon with the Gophers game will end in only 
10 four seconds. This type of information may encourage the user to select the content described in the 
window 4901. Similar types of information may be provided m other situations. For example, if the 
12 Gophers game were at half-time, the user may switch to a broadcast of another game (e.g., the 
Cardinals game) while the Gophers game is at half-time. The window 4901 in such a situation may 
Qi4 allow the user to keep track of when the Gophers game resumes for the second half. Similarly, the 
C user can keep track of when a particular program or sporting event (broadcast via audio, video, or 
ll6 Otherwise) ends, or when the Gophers game gets closer than it currently is. All this may be done 
2; while listening to the Cardinals game, or when other related content is bemg presented to the user. 

When the user selects the window 4901 in Hgure 49, the broadcast of the Gopher game is 
\^ . presented to the user, and the broadcast of the Cardinals game is turned off, or it may be reduced in 
mo volume. In Figure 50, the user has selected the content represented by the window 4901 in Hgure 49, 
thereby causing the display of Figure 49 to be updated to that of Figure 50. Window 4901 is the 
^ active window in Figure 50. The wmdow 4901 of Figure 50 shows the score of the Gophers game. 

The window 4805 may or may not remain on the screen. If it remams on the screen, it may be 
24 continually updated so that the score of that game is presented to the user, at least visually. In another 
embodiment, supplemental information about the content being presented in connection with the active 
26 window 4901 is presented to the user. This supplemental information may relate to the Cardinals 

football game, or it may describe another type of supplemental information. 
28 Supplemental mformation relating to the video presented in wmdow 4807 in Figures 48 and 49 

could also be presented to the user (e.g., m window 4901). For example, supplemental information 
30 could describe content that starts (or that can be configured to start) just as the video rendered in 
window 4807 completes. Alternatively, supplemental information from the manufacturer of a product 
32 that is used or shown in the movie (e.g., an automobile or clothing) could also be presented. Thus, 
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supplemental information can be presented in connection with many types of content, and need not be 
2 limited to text, but can folly encompass audio, video, animation, and any other type of content. 

For purposes of illustration and example, the network documents described and illustrated in 
4 many of the Figures herein are shown displayed within a window controlled by an application 
program, such as may be represented by wmdow 306 in Figure 3. It should be understood, however, . 
6 that such documents (or resources) could be displayed in other ways. For example, the contents could 
be displayed on Ae entire desktop, or a portion of the desktop. In another embodiment, the contents 
8 might be scrolled on the screen, perhaps under other wmdows. Further, wmdows could be controlled 
by the operating system, rather than by an application program. The manner in which mfonnation is 
10 being presented to the user herein is for illustration purposes only, and should not interpreted as 

limiting the present invention. 
12 Further, the present invention has been described principally in terms of computer network- 

av^lable documents contaming text, graphics, anunated graphics or other objects. It should be 
J!i4 understood that the present invention is not limited to only those particular types of network resources. 
C Rather, the present invention can be implemented using audio, video, or other types of multimedia 
2^ 16 beyond that shown. For example, the supplemental information could be an audio clip, or an applet or 
application program that carries out a usefol fanction that relates to the resource displayed or otherwise 
b^as presented to the user. In addition, the term ''computer'' as used herein should be interpreted broadly 
to encompass all systems, devices, or machmes that have a general or specialized processor or 
f!^i20 niicroprocessor or a similar device known in the art or hereinafter developed. 
^ : Also, embodiments of the present invention may be integrated with one or more payment or 

pZ2 transaction processing systems or the like so that a person viewing cert^ types of content and/or 
certain types of supplemental mformation or supplemental content will mcur a fee or a transaction cost. 
24 Authentication and automatic payments techniques may also be used. 

Generally, although the present invention has been shown and described with respect to 
26 specific embodiments and/or implementations, various changes and modifications, even if not shown or 
specifically described herein, may be applicable to the present invention, and are deemed to lie within 
28 the spirit and scope of the subject matter that is applicable to the present invention. Further, any 
specific features or aspects of the embodiments or implementations described or illustrated herein are 
30 not intended to limit the present invention in a manner not requured by the upended claims. 

32 INCORPORATION BY REFERENCE 
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The following pending U.S. patent applications are hereby fully incorporated by reference: 
2 application serial nos. 08/474,921 (entitled "Document Retrieval System Employing a Preloading 

Procedure''), filed June 7, 1995, now U.S. Patent No. ; 08/487,925 (entitled **Document 

4 Research System and Method for Displaying Citing Documents ''), filed June 7» 1995; 60/028,251 
(entitled ''A Method and System for Communicatmg Information About the Contents of a Document"), 
6 filed October 8, 1996; 60/047.554 ("A Document Retrieval System Including the Use of Profile 
Information"), filed May 22, 1997; and 60/052,830 C^A System and Method for Communicating 
8 Information Relating to a Network Resource"), filed July 17, 1997. Any references, applications, or . 

otiier subject matter incorporated by reference in these applications are also mcorporated by reference 
10 into this application. 

In addition, the following publications listed below are also hereby fully incorporated by 
12 reference to the extent that they enable, provide support for, provide a background for, or teach 
methodology, techniques, and/or procedures employed herein. 
^4 Reference 1: Yellin, The Java Application Programming Interface: Volumes 1 & 2 (Addison , 

= Wesley 1996) 

yl6 Reference 2: Campione, The Java Tutorial (Addison Wesley 1996) 

2 Reference 3: Chan, The Java Class Libraries (Addison Wesley 1997) 

MS Reference 4: Lemay et al., Java in 21 Days (Sams^Net 1996) 

Reference 5: Sun Microsystems, Inc., The JavaBeans 1.0 API Specification (Sun Microsysum 
RlQ 1996) (available at http://java.sunxom/beans) 

Reference 6: Sun Microsystems, Inc., The Java LI API Specification (Sun Microsystems 
Qz 1997) (available at http://java.sun.com/) 

^[ Reference 7: Bell, "Make Java fiist: Optimize!," JavaWorld April 1997 (JavaWorld 1997) 

24 (available at http://www.javav/orld.com/) 

Reference 8: Vanhelsuwe, **How to make Java applets start faster,* JavaWorld December 1996 
26 (JavaWorld 1996) (available at htQ>://www .javaworld.com/) 

Reference 9: Danesh, Jav^cript in a Week (Sams.Net 1996) 
28 Reference 10: Graham, HTML Sourcebook (2d ed. John Wiley & Sons 1996) 

Reference 11: Tanenbaum, Computer Networks (2d ed. Prentice Hall 1989) 
30 Reference 12: Jamsa, Internet Programming (Jamsa Press 1995) 

Reference 13: Comer, Internetworking witii TCP/IP, Volumes 1, 2, & 3 (3d ed. Prentice Hall 

32 1995) 
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Reference 14: Lemay, Official Marimba Guide to Castanet (Sams.Net 1997) 

Reference 15: Kovel et al., The Lotus Notes Idea Book (Addison Wesley'1996) 

Reference 16: Schneier, Applied Cryptography (2*^ ed. John Wiley & Sons 1996) 

Reference 17: Adkins> Internet Security Professional Reference (New Riders 1996) 

Reference 18: Chappeli» Understanding ActiveX and OLE (Microsoft Press 1996) 

Reference 19: Denning, OLE Controls Inside Out (Microsoft 199S) 

Reference 20: Brockschmidt» Inside OLE (2d ed. Microsoft 1995) 

Reference 21: Siegel, CORBA Fundamentals and Progranuning (John Wiley & Sons 1996) 

Reference 22: Petzold, Programming Windows 95 (Microsoft 1996) 

Reference 23: Prosise, Progranmiing Windows 95 with MFC (Microsoft Press 1996) 

Reference 24: Microsoft Corporation, Windows NT Server Resource Kit (Microsoft Press 

Reference 25: Russel, Running Windows NT Server (Microsoft Press 1997) 
Reference 26: Chapman, Building Internet Applications with Delphi 2 (Que 1996) 
Reference 27: Cantu, Mastering Delphi 3 (Sybex 1997) 
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